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Abstract  Ground  Moving  Target  Indication  provides  a  unique  source  of  information 
for  the  exploitation  of  surface  and  low  flying  aircraft  at  long  range,  in  all  weather, 
providing  situation  awareness,  targeting,  and  intelligence  information.  While 
airborne  moving  target  indication  and  fire  control  radars  have  been  around  for 
a  long  period  of  time,  it  has  been  only  the  last  decade  when  Ground  Moving 
Target  Indication  (GMTI)  data  has  been  collected  and  used  to  prosecute  mobile 
surface  targets.  This  presentation  addresses  the  use  of  GMTI  data  from  providing 
intelligence  information  to  the  analysis  and  leads  to  the  challenges  associated 
with  doing  long-term  track  maintenance.  The  intelligence  community  has  been 
expressing  interest  in  GMTI  data  since  1999  when  investments  were  made  to 
develop  the  first  exploitation  capability  that  focused  on  products  from  Joint  STARS 
GMTI  data  providing  a  web  based  capability  to  process  and  exploit  Joint  STARS 
data  via  a  Network  Centric  Architecture.  At  the  same  time,  DARPA  and  AFRL 
were  pursuing  the  Long  Term  Track  Maintenance  challenge  performing  multi¬ 
platform  command  and  control,  horizontally  fusing  multiple  sensors  with  weapons 
for  a  long-range  precision  fire  control  system.  The  focus  of  this  presentation  is 
to  cover  performance  metrics.  The  metrics  will  be  associated  with  operators-in- 
the-loop  evaluations  looking  at  intelligence  and  analysis  for  the  find,  fix,  track, 
and  assess  portion  of  the  weapon.  The  second  set  of  metrics  focus  on  long¬ 
term  track  maintenance  evaluations.  Track  accuracy  and  persistence  in  time 
critical  targeting,  which  address  the  track,  target,  and  engage  portion  of  the 
weapon  chain.  Programs  to  be  discussed  include  the  Moving  Target  Information 
Exploitation  System  (MTIX)  program  with  respect  to  intelligence  products,  the  Multi- 
Platform  Tracking  Exploitation  (MPTE)  and  the  Affordable  Moving  Surface  Target 
Engagement  (AMSTE)  programs  with  respect  to  Long  Term  Track  Maintenance 
and  Precision  Fire  Control. 
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Ground  Moving  Target  Tracking 

—  Performance  Measures  for  Tracking  Targets 

—  Sources  of  Analysis 

•  Multi -Platform  Tracking  Exploitation  (MPTE) 

•  Affordable  Moving  Surface  Target 
Engagement  (AMSTE) 

—  Well  Defined  Metrics 

Ground  Moving  Target  Exploitation 

—  Exploitation  MOPs/MOEs  (use  of  the  data  and 
performance  of  the  systems) 

—  Moving  Target  Information  Exploitation  (MTIX) 
Features 

•  OIF,  Korea,  DCGS 


—  Metrics  Maturing 
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Indicators  of  Association  Complexity 


1)  Normalized  Target  Density  -  Number  of  detections  competing  for  association. 
Dependencies 


Multi-Dimensional  Sensor 
Observation  Error  Volume 
(Azimuth  x  Range  x  Doppler  x ...) 


Observation  Error  Volume 
-Dimensionality 
-Measurement  Errors  (a) 

-Vehicle/Sensor/ROI  Geometry 
-Sensor  distance  from  ROI 
Number  of  Nearby  Confusers 
-Density  of  Targets 
-False  Alarm  Rate 
-False/Branch  Track  Rate 

NTD  quantifies  the  measurement  error  contribution  to  association  error. 


Non-Competing 

Detections 


21  Gap  Time  -  Time  between  a  target’s  detections.  (Amount  of  time  to  extrapolate  track  and  track  error.) 


Dependencies 

Sensor 

-Revisit  rate 

-Probability  of  Detection 
-Clutter  cancellation  technique  (MDV) 
-Sensor  availability 
Environment 
-Terrain  blockage 

-Target  speed  relative  to  mainlobe  clutter 
-False/branch  track  rate 


Gap  Time  quantifies  the  prediction  error  contribution  to  association  error.  amste  managed  this 

asymetrically  (revisits 
when  needed) 

System  of  Systems  designs  must  drive  down  Gap  Time  and  Normalized  Target  Density  3 


Intel  and  Analysis  Metrics 


Operator-1  n-The-Loop  Experimentation 

Sensor  Configurations 

21  Ball  Low  Earth  Orbit  Constellation 
8  Ball  Wolf  Pack  8/1/1 
10  Ball  Mid  Earth  Orbit  Constellation 

Scenario  Volume 

160  Vehicle  “Davison  Challenge”  140  Vehicle  Korea 

2  Convoys  plus  background  traffic  4  Convoys  plus  background  traffic 


10,000  Vehicle  RT-1 

25  Convoys  plus  background  traffic 


15,000  Vehicle  RT-2 

34  Convoys  plus  background  traffic 


MTIX 

Operator 

Auto  Assisted  T racker 


Experience  Operators  Metrics 

Link  16  Messages 
Recorded  for  Post  Processing 

Border  Crossings 
JSWS  MATrEx  Convoy  Following 

Operator  Operator  Volume  of  Coverage 

No  Auto  Tracking  Auto  Only  Tracker  Tracklets  4 

AFRL  Developed  Simulations,  Models,  and  Metrics 


Simulation  Exercise 


JSWS  MTOC  MAT  REX  MTIX  SA1M  IIES  Simulation  NCSA 

Tools  Testbeds 


October  2003  Exercise 

Location:  NC3AThe  Hague,  NE 
Experience  Army  and  AF  Operators 
Robust  2  Week  Scenario 
NC3A  Dev.  Hostile  &  Friendly  Targets 
AFRL  Dev.  Civilian  Targets 

TTPs  and  CONOPS 


Operators  Nominated  Link  16 


Use  of  J3.5  Message  Set 


AFRL 

SETUP 


A 


DIS  PDU  Lan. 
NATO  Ex  Lan. 


Global-Hawk  Sim,  U2-AIP  Sim 
FTI  program  (PC/Linux) 
(PC/Linux) 


CSP, 

GVS  Playback, 
Data  Logger 
(Sun/Solaris) 


Data  logged  for  post  analysis: 

All  DIS  entity  states 

-  PDU  timestamp  vs.  time  received 

-  Compressed  and  stored  as  NRTTDF 

•  All  NatoEx  GMTI,  FreeText,  and  RSRs 

•  All  JTIDS  J2.2  (Ownship)  and  J3.5  (Track)  messages 


Number  of  MU  Reports 


Total  GMTI  reports  -  all  sensors 


400000 
350000 
300000 
250000 
200000 
150000 
100000 
50000 
0 

mon  tue  wed  thur  frl  mon  tue  wed  thur 


□  GMTI  on  Civilians 

■  GMTI  on  Friendlies 

■  GMTI  on  Hostile  Targets 

•Based  on  all  sensor  data 
combined 

•Does  not  include  false  alarms 
or  MTI  on  airborne  targets 


Total  1.5+  million 
GMTI  reports 

Does  not  include  MTI  that 
did  not  associate  with 
ground  targets. 

Based  on  truth  id  set  by 
sensor  simulations. 
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Total  GMTI  per  sensor 


■V STARS 

□  U2AIP 

□  RAD  SAT 

■  HORIZON 

■  HALE 

■  G-HAVUK 

□  CRESO 

1AST0R 

MTI  on  ground  targets  only. 

Does  not  include  false  alarms  or  MTI  on  airborne  targets. 
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GMTI  reports  on  red/hostile  targets  only 
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mon  tue  wed  thur  fri  mon  tue  wed  thur 


Red  Targets  Only 


2% 


3W 


6% 


Targets  Detected  by  GMTI  Radar 
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mon  tue  tue  wed  thur  thur  fri  fri  mon  tue  tue  wed  wed  thur 

Based  on  all  sensors  combined.  I  nconfusers  visible 

Ground  targets  only.  □  Friendly  Targets  Visible 

Some  runs  are  divided  into  AM/PM  segments.  . .  _ . 

°  ■  Ho  stile  Targets  Visible 
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V^Uniquc  Tracks  per  System  -  Red/Hostile 

Targets  Only 


10 
9 
0 
7 
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1 
0 

mon  tue  tue  wed  thur  thur  fri  fri  mon  tue  tue  wed  wed  thur 


□  IIES-2-DORNIER 

□  SAIM 

■ VSTARS 

□  IIES-1-DQRNIER 

■  MATREX 

□  MTOC  1 

■  ASTOR-GS 

□  H  ORIZQN-GS 

□  CRESO-GS 

■  NIT  DC 

■  J  STARS -TMSS 


24% 


Track  ID  Lifetime  -  Hostile  Targets 


1 .08  Minutes  average  across  all  J3.5  Tracks  on  red  targets 


Track  Updates  are  Today  Performed  through  Voice  Updates 
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Operator/Track  Metrics  Summary 


•  Current  Army  and  Air  Force  Operators  are  use  to  Joint  STARS 
•There  was  an  Operator  Dependency  on  Joint  STARS 


•  During  the  second  week,  operators  tracked  mostly  friendly  targets 
-Difficulty  with  Intel  given  to  operators  or  IPB  ? 


•  Track  ID  lifetimes  averaged  slightly  more  than  1  minute 

•Not  Unexpected,  current  CONOPS  and  tools  do  not  allow  for 
Continuous  Updates 


•  The  majority  of  track  update  messages  came  from  MTIX  (67%) 

-In  one  case  2000+  track  messages  were  received  for  4  tracks. 

•  The  majority  of  targets  tracked  came  from  TMSS: 

TMSS  (28%),  HORIZON  (24%),  and  MTIX  (17%) 

•  The  majority  of  threat  targets  tracked  came  from  TMSS  : 

-  TMSS  (40%),  MTIX  (24%),  and  HORIZON  (21%) 

-  In  one  case  1  operator  track  switched  between  19  red  targets. 


MPTE  Experiment  -  Tracker 

Maturation 


•Real-Time  Fusion  &  Exploitation  at  Palmdale. 
•Coordinated  ISR  collection. 

•Dynamic  re-tasking  demonstrated. 

•3  Data  collects  over  3  days.  34  inst.  targets. 
•Ground-based  emphasis  for  evaluation  &  analy 


Palmdale 


AFRL, 
Black  River 


Raytheon 


GNITI  collected  on 
GROUND  network 


MPTE  program  serves  as  tracking 
benchmark  in  2001. 
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Sample  Data 


Measurements  very 
accurate  with  quick 
revisits.  Bias  correction 
attempted  during 
experiment.  More 
systematic  approach 
during  track  evaluation 
phase. 


Platform  1 


Range  measurement  very 
accurate  with  larger 
cross-range  error 
expected  (smaller 
antenna).  No  bias 
apparent. 


Platform  2 
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Single  Target  -  Probability  of  Tracking 


Gap  Times  (seconds) 


Detections  in  Track 


Truth* 


Target  Errors  . 


Pedigree  Truth-to-Track 
K 


Truth 


Track  R 


Track . 


Total  Track  Lifetime  include  track  switching 
Track  Identity  Lifetime  excludes  track  switching 


Results  Show  What  is 
Now  Called  Tracklets 


Track  Identity  Lifetime  (TIL) 


This  is  what  is  in  the 
Track  Data  Base 


6  8 
Time  fminutesl 

Total  Track  Lifetime  (TTL) 


Mean  : 
1-Sig: 
Median : 
25%: 
75%: 


6.4 

5.2 

5.3 
2.1 
9.1 


6.4  Minute 
Average  TTL* 


30 


Affordable  Moving  Surface  Target 
Engagement  (AMSTE) 


ISR  Datalink  Global  NCtWOrk  CeiltliC 


^  Multi-laterationfor 

Accuracy 


Network  Centric  Architecture 
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AMSTE  Data  Fusion  System 
Architecture 


Moving 

Ground 

Target 


Inputs  from  Dual 
ISR  Radars 


GMTI&HRR  Reports, 
A/C  state,  Sensor  Status 

Radar  Data  2 


Dual  Radar  Commands 


GMTI,  HRR,  HUR 
Requests 

DATA  FUSION  SUBSYSTEM 

(DFS) 


Sensor  Resource 
Manager 


Multiple 

Feature- 

Hypothesis 

Aided  Track 

Tracker 

Stitcher 

%/.  Mole  Ctrl  2 

% 


GMTI,  HRR,  HUR 
Requests 


Given  ISR  GMTI  detections, 
the  challenge  is  Long  Term 
Track  Maintenance  (>20  min.) 


Nomination  &  0 

Control  Commands 


Fused  Track  Operator 
Reports  (--5 


In-Flight  Track 
Updates 


Weapon 

Updates 


The  DFS  accepts  ISR  radar  data  and  operator  commands, 
and  controls  the  weapon  aimpoint  and  both  radar  systems. 
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AMSTE  Oct  03  Exercise 


•October  7th  and  9th 

•6  Convoys 

•2-6  Vehicles  each 

•Events 
•Passing 
•Intersection 
•Move-Stop-Move 
•On-Off  Road 
•Terrain  Blockage 

•Features 

•HRR 

•RCS 

•TEA 


17  Scenarios  included  in  about  7  hours  of  data  collection  each  day 


Each  Confusion  Event  is  Scored  Based  on  Difficulty 
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Track  Identity  Lifetimes  (TIL)  -  506 


(with  and  without  manual  intervention) 


07-October,  2003  Flight  506 


□  TIL  -  No  Man,  (min)  15.2  7.3  1.8  5.9 
IE  TIL  -w/  Man.  (min)  25.8  30.5  17.4  31.3 


7.4  8.7  2.7 

7.4  27.3  2.7 


1.3  6.4  6.7 

12.8  24.9  18.7 


14.8  7.2 
33.4  20.5 


3.1 

6.1 


2.9 

19.2 


7.8  4.3 

31.5  31.1 


10.4  16.5 

33.5  28.3 
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Weapon  Drop 


Weapon  Drop 

•  F16  ~  5  miles  range 

•  Live  JDAM,  GPS  Guided 

•  EPLRS  Weapon  Data  Link 

•EPLRS  Inter  Platform  Comm. 

•GMTI  Coord.  Passed  to 
Weapon  In  Flight  from  JSTARS 


Multi-Platform  Fusion  of  GMTI  Achieves  Accuracy 
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Summary 


*  GMTI  Tactical  Grade  Tracking  is  “Hard” 

—  Well  Defines  Measures  of  Performance 
—  State  of  the  Art  is  Improving 
—  Requires  Significant  Resources 

*  State  of  the  Art  in  Improving 

—  MPTE  achieved  3.6  minutes 
—  AMSTE  improved  this  to  7.2  Minutes 

*  Situation  Awareness  Metrics  need  Maturing 

—  Operator  in  the  Loop  Measures  Provide  a  Unique  Result 
—  Tracks  are  only  performing  “Book  Keeping” 

—  Detections  Provide  Some  Unique  “Pattern  Analysis” 


